DOCKET NO. 2001 -01 61 C 



1/15 



S 



£ ^ ^ 

^ 

^- 3 CD 



CO cu 



CO 
CD 



S 



^ <=> 



I 

CD 



^ CD V 
CO -<t 
CO del 

CO CO w\ 




CNJ 



s 











CD 




CD 




O 


Q- ^ 


CO 




CI. 


CO 


1 


:£ 

CO 


CJ> 

o 






Q. 
UJ 




o 


ac 


-< 
Q_ 




ex. 


CO 







CO 

SI 



CO 



o 
o 



X 

CO 

tz —J 

s => 



CVJ 

SI 



CO 



UJ <^ 

~~> CD 
CO c_> 



CD Q- 
S=r CD 



I 

CD 



o 

On! 



oo 
o 

SI 



CD ck: 
CD ^ CD 
ol ^ oo 



CO 



-co 



CD 

o 



^ CD Q= 



oo 



CO 
CD 



CD 
cvl 

SI 



CD 



o 
oo 



CO 
CO 



o 

CD CO UJ 



CD 

CO 



m CD 



CD 



Osl 



CO 






CD 
UJ 




CD 




UJ 




OO 


^ 


Co 


CD 


UJ 






CD 


Q_ 


CD 


CO 




UJ 
CD 




CO 


>^ 







ro 
Cvl 

S 



Cvl 
Cvl 

w 



CD 



CD 



CI. 

oo 



CD 
CO 
S CO 

!Z3 UJ 

Q- CD 
3 CD 

CO p- 

OO 
CD 
O. 



oo 

Cv4 
Cvl 



CO 
Csl 
Cvl 

SI 



CD UJ 

UJ CD . . 

^ o ^ 

OQ CD I 
CD UJ CD 
CD UJ 
CD Q- 
UJ CO 



Cvj 



O 
Cvl 
cvl 

S 



oo QC 

r— I , I 

y >< 

UJ ^ UJ 



QQ 
<Z> 



po 13 



5; s 



ro 
ro 
ro 
ro 



CD 
OO 



C-> 

<7) 

oo 

:3 

C^ 



CD O Ck: 

2- ^ O LxJ ^ 

CO c3 ^ ^Zi g 

oo u*j o rr P- trj-j 

c-> i-*J ^ _j o 

o oo ca ^ P= CD 

_. o > Jt? z 

Q- c-> o fc3 i-J 



2/15 



CD 

to 

ro 



oo 
ro 



ro I 
I 



ro t-- 
ro I 















CD 




UJ 




CO 






LiJ 

CO 






UJ 


UJ 
C=l 


0 




-< 




—J 


CD 


CD 








cr 


UJ 




Csl 
CD 
ro 



-Si* 




00 






CO 
CO 
ro 


VIDEO 


:gment 


SCENE 


SEMBLE 






00 




CO 



cr> 

1*0 


























ro 




0 

UJ 


00 






Pi 








> 

UJ 


UJ 

0 

CD 


00 

CO 

ro 


00 
1 — 


0 


UJ 
CD 




ro 








s 


UJ 


UJ 


CO 






CD 


ro 




0 


UJ 
00 






CD 














r-* , 

ro 




CO ^ 

ro 















UJ 


CODING 






ICATI 


CD 
Z£ 


UJ 


CODE 


u. 








UJ 


00 


CD 








00 

:3 

CD 


ESSIN 


N. AN 


POST 


CD 
t= 




CD 






Q_ 


h— 


CD 


CD 
UJ 


UJ 

CO 


a2 
CD 


UJ 


Q_ 


0 


CO 




UJ 






UJ 


CD 
UJ 


0. 


UJ 

CO 






CO 











ro 



CO 
CO 

ro 




( 

\ 



3/15 




4/15 



oo 
o 



C5 
l*0 



CO I 



Si 



CO 

to 

CO 





00 






pi 






















2: 




a:: 

UJ 




UJ 






Q 

0 


U_l 


CO 


0 





IT) 
CO 







X 




















in 

CO 






1 — 


UJ 






UJ 










UJ 






UJ 


0 












CD 
UJ 


CO 






CO 


CO 






UJ 

CO 





CO 



5; 




to 























to 


1 — 


CO 






to 


Oil 


1 — 






0;= 




O 






O 


O 




O 




l-l-l 


Oc:: 




E6M 








era 


CO 




X 




oo 




X 


SUBS 




LU 

£=3 

12: 




OQ 
CO 









h- 


CO 


O 


O 










o 







1 






1 


CO 


CD 




S 








c_> 


( — 

1 




o 




7/15 



FIG. 9 



312^! K306 




906 



GENERIC MODEL 
VIDEO ENCODER 



908 



CONTENT MODEL A 
VIDEO ENCODER 



910 



CONTENT MODEL B 
VIDEO ENCODER 



1 



912 



CONTENT MODEL G 
VIDEO ENCODER 



.1 



914 



\ 

1 



I 
I 
I 



8/15 




FIG. 1 1 

^348_ 



9/15 



306 



SEGMENT DESCRIPnON ENCODER 



308 



1102 



SEGMENT DESCRIPTORS, 
ID, TIME CODE VALUES 
TO INDICES MAPPER 



1104 



1106 



1110 



INDICES TO 
BINARY CODE 
LUT 1 



1109^ 



350A 



1108- 



LUT 1 
ADDRESS 



1119 



1118- 



LUT 2 
ADDRESS 



1122 



1130 



1146- 



LUT 5 
ADDRESS 



350B 



^310 




SUBSEGMENT/ROI 
DESCRIPTORS. ID, TIME 
CODE VALUES TO 
INDICES MAPPER 


^\^\^ 


INDICES TO 
BINARY CODE 
LUT 2 




f350C 


1-312 








^ 3500 













1 

r322 




PREPROCESSING 
VALUES TO INDEX 
MAPPER 




INDEX TO 
BINARY CODE 
LUT 3 


1 


















1128^ 








1126-^ 


LUT 3 










ADDRESS 








fWll 








f 332 




CONTENT MODEL VALUE 


/-1134 


INDEX TO 
BINARY CODE 
LUT 4 


1 


C350F 






TO INDEX MAPPER 












1138>--^ • 








1136^ 


LUT 4 










ADDRESS 








1-1142 




.1150 




r346 




CODING NOISE FILTER 
VALUES TO INDICES 
MAPPER 


/-1144 


INDICES TO 
BINARY CODE 
LUT 5 




^ 350G 


















1148^ 





FIG. 12 



362 



10/15 





SEGMENT DESCRIPTION DECODER 






r360A 




1-1206 


/-1208 ^ 




f364 _ 




BINARY CODE 


INDICES TO SEGMENT 


1 










r360B 




TO INDICES 




DESCRIPTORS, ID, TIME 




366 




LUT 1 


CODE VALUES MAPPER 
















1 


204^ 








1 


1202^ 


LUT 1 
ADDRESS 




1 








1-1216 




1-1220 


^368 ^ 


r360C 




BINARY CODE 
LUT 2 


r\m 


INDICES TO 


1 


^-3600 




^1219 


SUBSEGMENT/ROI 
DESCRIPTORS, 10, TIME 




,370 








CODE VALUES MAPPER 










1214^* 

1 










1212-^ 


LUT 2 










ADDRESS 












1-1226 




^1230 




f obUL 




BINARY CODE 
TO INDEX 


f \llO 


INDEX TO 
PREPROCESSING 




^372 
















LUT 3 




VALUES MAPPER 








1224^ 






1 




1222^ 


LUT 3 
ADDRESS 












f\m 




/1240 




icnr 
f obUr 




BINARY CODE 
TO INDEX 
LUT 4 




INDEX TO CONTENT 












MODEL VALUE MAPPER 










1234-^ 










1232^ 


LUT 4 
ADDRESS 












f\m 




1-1250 




r360G 




BINARY CODE 
TO INDICES 


^^1248 , 


INDICES TO CODING 
NOISE FILTER VALUES 




J- 376 
















LUT 5 




MAPPER 










1244^ 









1242- 



LUT 5 
ADDRESS 



11/15 



FIG. 13 



364^ 1^368 




378 



MODEL VIDEO DECODERS 



1306 



GENERIC MODEL 
VIDEO DECODER 



1308 



CONTENT MODEL A 
VIDEO DECODER 



1310 



CONTENT MODEL B 
VIDEO DECODER 



1312 



CONTENT MODEL G 
VIDEO DECODER 



1 



1314 



I 
I 

f- 



J 



T 

380 



12/15 




13/15 



390 
i 



FIG. 15 

368^' 



VIDEO SEGMENTS 
SCENE, ASSEMBLER 

r 1504 



1512- 





BUFFER 








/-1506 


.--1 




BUFFER 


1 




1 

L 


/1508 




BUFFER 









1520 



BUFFER 



1522 



BUFFER 



JL 



1524 



BUFFER 



1526 



t 

1- 



♦ 



370 



CONTROLLER 



1528 



LJ 



JL 



1514 



BUFFER 



1530- 



1534 



BUFFER 



[^1532 



FIG. 16a 



1602- 



14/15 
( START ) 



ANALYZE INPUT VIDEO, CUSSIFY 
AND EXTRACT VIDEO SEGMENTS 



1606^ 
1608^ 

1612^ 
1616- 



INPUT NEXT VIDEO SEGMENT 



I 



ANALYZE VIDEO SEGMENT, 
IDENTIFY SUBSEGMENTS/ROI 



I 



SELECTIVELY. SPATIALLY AND 
TEMPORALLY DOWNSAMPLE 
SUBSEGMENTS/ROI 



T 



ASSIGN AN APPROPRIATE MODEL 
TO EACH SEGMENT IF POSSIBLE 




ENCODE USING AN ENCODER 

FROM PLURALITY OF 
ENCODERS, EACH ASSOCIATED 
WITH SPECIFIC CONTENT 
MODEL 



YES 



i 



1622 



ENCODE USING GENERIC MODEL 
ENCODER 



ESTIMATE DIFFERENT TYPES 

OF CODING NOISE, AND 
FILTERS FOR THEIR REMOVAL 



T" 

1626 



1632 



jL 



1604 



REPRESENT 
DESCRIPTORS 



1610 



REPRESENT 
DESCRIPTORS 



1614 



REPRESENT 
DESCRIPTORS 



1618 



REPRESENT 
DESCRIPTORS 



JL 



1628 



REPRESENT 
DESCRIPTORS 



1630 



ENCODE 
SEGMENT 
DESCRIPTION 




QnT) 



FIG. 16b 



15/15 



( START ) 



OPEN CONNECTION TO CHANNEL 
TO BEGIN RECEIVING BITSTREAM 

-1 



CONTINUE RECEIVING BHSTREAM 
AND DEMUinPLEX 




1702 



1704 



1712 



1708- 



1 



DECODE 
SEGMENT 
DESCRIPTION 



1714 




y^1710 




DERIVE 




DESCRIPTORS 



S 1 



DECODE USING 
GENERIC MODEL 
DECODER 



I 



DECODE USING DECODER FROM A 
PLURALITY OF DECODERS, EACH 
ASSOCIATED MTH A SPECIFIC 
CONTENT MODEL 

\ 



1716 



— |X 

APPLY CODING NOISE REMOVAL HLTERS 



1720 



1718 



DERIVE 
DESCRIPTORS 



SELECTIVELY, SPATIALLY AND TEMPORALLY ^ 
UPSAMPLE SUBSEGMENTS/ROI 



I 





DERIVE 




DESCRIPTORS 



I 



-1722 



ASSEMBLE VIDEO SEGMENT 
FOR OUTPUT TO DISPLAY 






DERIVE 
DESCRIPTORS 


1730 


DERIVE 
DESCRIPTORS 





1726 



1728 



C END ) 



